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Coevolution of two species is typically thought to favour the evolution of faster evolutionary rates 

helping a species keep ahead in the Red Queen race, where 'it takes all the running you can do to 

stay where you are'. In contrast, if species are in a mutualistic relationship, it was proposed that the 

Red King effect may act, where it can be beneficial to evolve slower than the mutualistic species. 

The Red King hypothesis proposes that the species which evolves slower can gain a larger share 

of the benefits. However, the interactions between the two species may involve multiple individuals. 

Cn To analyse such a situation, we resort to evolutionary multiplayer games. Even in situations where 

^-H evolving slower is beneficial in a two-player setting, faster evolution may be favoured in a multiplayer 

O setting. The underlying features of multiplayer games can be crucial for the distribution of benefits. 

CN They also suggest a link between the evolution of the rate of evolution and group size. 
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I. INTRODUCTION 



Mutualistic relationships, interspecific interactions that benefit both species, have 
been empirically studied for many years |T-7] and also a considerable body of theory 
has been put forth trying to explain the evolution and maintenance of such relation- 
ships [8-15J. Many of these studies utilize evolutionary game theory for developing 
the models. The interactions in these models are usually pairwise. A representative 
of each species is chosen and the outcome of the interactions between these rep- 
resentatives determines the evolutionary dynamics within each of the two species. 
However, in many cases interactions between species cannot be reduced to such 
pairwise encounters [16J. 



For example, in the interaction between ants and aphids or butterfly larvae [171 - 
[19] many ants tend to these soft bodied creatures, providing them with shelter and 
protection from predation and parasites in exchange for honeydew, a rich source of 
food for the ants fTS', "20]. This is not a one to one interaction between a larva and 
an ant, but rather a one to many interaction from the perspective of the larva. In this 
manuscript we focus on this kind of - possibly - many to many interactions between 
two mutualistic species. 

To analyse how the benefits are shared between the two mutualistic species, we 
make use of evolutionary game theory |12TI - [23] . Following Bergstrom & Lachmann 
[12] . we analyze the interactions between two species with a twist to the standard 
formulation. The two interacting species can have different evolutionary rates. In 
coevolutionary arms races, where species are locked in antagonistic relationships 
such as host-parasite interactions, we observe the Red Queen effect [24J. In these 
cases a higher rate of evolution will be beneficial, as it would help the parasite infecting 
a host or a host escaping from a parasite. However, in mutualistic relationships a 
slower rate of evolution was predicted to be more favourable [1 2J. Hence, it is possible 
that the type of relationship between two species affects the evolution of the rate of 
evolution. As mentioned in [12J and [25] the different evolutionary rates could be due 
to a multitude of factors ranging from different population sizes to the differing amount 
of segregating genetic variance. The implications of a difference in evolutionary rates 
are not limited to mutualism and antagonistic relationships. Epidemiological modeling 
and data have shown correlations between the rate of epidemic spreading and the 
evolutionary rate of the spreading pathogen f26l[27] . 

We first recall the mutualistic relationship between two species in a two player 
game, as proposed by Bergstrom and Lachmann. Then, we increase the number 
of players. Note that we do not increase the number of interacting species [28^,'295, 
but rather the number of interacting individuals between two species (also see [30]). 
We include asymmetry in evolutionary rates and discuss its effect both in two player 
and in multiplayer games. We find that when in a two player setting it is beneficial to 
evolve at a slower rate, it can be detrimental in a multiplayer game. 



II. MODEL AND RESULTS 

To set the stage we first recapitulate the two player model presented in [12J albeit 
with different notation. They considered two species each with two strategies, "Gen- 
erous" and "Selfish". Each species is better off being "Selfish" as long as the other 
one is "Generous". If both are "Selfish", then no mutualistic benefit is generated and 
hence in that case it is better to be "Generous". 

Under these assumptions, the payoff matrices for the interactions describing the 
interactions of each type with one member of the other species are 

Species 2 Species 1 



G2 S2 Gi Si 



Species 1 ?^ ^^-^^ ^^-^^ Species 2 ^^ ^^-^^ ^^-^^ 



where for example a generous member of species 1 obtains aG^,s2 f^o"^ ^^ interac- 
tion with a selfish member of species 2, whereas the latter obtains as^^Ci- In our 
case, we have a^Cj < cls^.Gj and as.^Sj < cLCi.Sj for i,j = 1,2. This ordering of 
payoffs corresponds to a snowdrift game (STJ (see Appendix) where there exists a 
point where the two strategies can coexist. This is because if both the players are 
"Generous" then one can get away with being "Selfish", but if both are "Selfish" then 
it actually pays to be "Generous" and chip in. For a snowdrift game in a single species 
the coexistence point is stable, i.e. deviations from this point bring the system back 
to the equilibrium, because the deviators would always be disfavoured by selection. 
However for a snowdrift game between two species, this coexistence point is unstable 
as each species would be better off being "Selfish", i.e. exploiting the deviation of the 
over species. 

The frequency of players playing strategy "Generous" (Gi) in species 1 is given by 
X and in species 2 (G2) by y. The frequencies of players playing strategy "Selfish" (Si 
and S2) are given by 1 -x and l-y\n species 1 and 2, respectively. The fitness of the 
generous strategy in species 1 , fc^ depends on the frequency y of generous players 
in species 2, fciiy)- Equivalent^, the fitness of the generous strategy in species 2, 
/g2 depends on the frequency x of generous players in species 1 , /g2(^)- The repli- 
cator dynamics assumes that the change in frequency of a strategy is proportional 
to the difference between the fitness of that strategy and the average fitness of the 
species / [23, 32, 33J. Thus, the time evolution of the frequencies of the "Generous" 
players in the two species are 

X = r^x (/gi (y) - /i (x, y)) 

y = Tyy {fG2{x) - f2{x,y)) . (1) 

The parameters r^ and ry are the evolutionary rates of the two species. We first 
recover the scenarios described in [12J. If the evolutionary rates are equal (r^ = ry) 
and the evolutionary game is symmetric, then the basins of attraction of {Si,G2) 
and (Gi,6'2) are of equal size (Fig. [T] Panel A). For unequal evolutionary rates, the 
species which is evolving slower (in our case species 1 with the rate r^ = ry/S) has 
a larger basin of attraction (Fig. [T] Panel B). This asymmetry where most of the initial 



conditions lead to an outcome favouring the slower evolving species has been termed 
as the Red King effect [1 2J. 

We now extend the above approach to multiplayer games. Extending the number 
of players from 2\o d adds a polynomial nonlinearity to the fitness functions of the 
strategies (see Appendix). For a multiplayer game we no longer have a 2 x 2 payoff 
matrix, but rather a payoff table. For this, we use the proposal from [34J for a d- 
player snowdrift game, where the costs of being generous are divided among the 
"Generous" players. In addition, only if there are at least M "Generous" players, 
a benefit is produced. That is, for /c < M "Generous" players, each one of them 
exhibits a loss of c/M and the "Selfish" players obtain nothing. If there are at least M 
"Generous" players, then a benefit is produced. The "Generous" obtain b - c/k and 
the "Selfish" obtain h at no cost. For species 2 we can write down a different payoff 
setup which could have different values for 6, c, M, d etc. thus creating a "bi-table" 
game. For the time being, we assume that the payoff setups are symmetric for the two 
species and hence we just elucidate the details for species 1. The exact formulation 
of the payoffs and the calculations of fitness values are given in the Appendix. 

Note that for (i = 2, M = 1, 6 = 2, and c = 1 we recover the matrix used in [\2\ . 
Even for these new fitness functions for multiplayer games, the dynamics are still 
given by the replicator equations [35-37J. Also note that for two player games with 
M = 1, there are four fixed points in which each species is either selfish or generous. 
In addition, there is an internal fixed point given by x = ?/ = 2(6 - c)/(26 - c) = |. 
The position and the stability of the fixed points is independent of the evolutionary 
rates, but as we will see, it depends on the number of players d. For a 20 player game 
{d = 20), the basins of attractions are still of the same size, but the dynamics leading 
to the stable points on the vertices are completely different (Fig. [T] Panel C, r^ = Vy). 
The internal equilibrium has now shifted \o x = y = 0.063. As before, we introduce an 
asymmetry in the evolutionary rates. Interestingly, we find that for a 20 player game 
(Fig. n] Panel D, r^ = r^/8) for the same asymmetric values of growth rates as in the 
two player case, most of the initial conditions lead to a stable point where species 2 
is selfish and species 1 is generous (Gi, S2). This reverses the result which we got 
from d = 2. Everything else being the same, in the presence of multiple players, the 
Red King effect is not observed in this example. 

Next, we explore the process due to which the Red King effect vanishes. The 
replicator solutions of the two species creates quadrants in the state space (0 < 
x,y < 1). Of these quadrants, the top right and the bottom left are of special interest 
as they contain the curve that separates the two basins of attraction (the blue and 
red sections in Fig.[l}. Hence all points starting on one side of that curve lead to the 
same equilibrium. Consider the top right quadrant. Species 2 is represented by the 
^-axis. A faster evolution by species 2 results in most of the initial conditions leading 
to the outcome favourable for species 2, i.e. (G'1,6'2). An exactly opposite scenario 
is taking place in the bottom left quadrant. Hence in this quadrant as species 1 is 
evolving at a slower pace than species 2, most of the initial condition here lead to an 
outcome favouring species 1, i.e. (6'i,G2). As long as the internal equilibrium is on 
the diagonal the Red King effect depends on the sizes of these quadrants. Changing 
the number of players alters the sizes of these two influential quadrants. For example 
consider the case of the twenty player game (Fig.[l]Panel C-D). The size of the bottom 
left quadrant is reduced to such an extent that almost the whole state space leads to 
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Figure 1. The composition of both species can range from all selfish {S) to all generous {G). If the 
other species is sufficiently generous, selfish behaviour is favoured in both species. However, if the 
other species is selfish, generous behaviour is advantageous. This is captured by the snowdrift game 



discussed in the text. For equal evolutionary rates, Vx 



y, the basins of attraction for the two outcomes 



{Si , G2) and {Gi , &) are of equal size (Panels A and C). The colours illustrate the regions leading to the 
outcomes favourable to species 1 (blue shaded area leading to {Si^G2)) and species 2 (red shaded area 
leading to (d, 82))- For a two player game, d — 2, and Vx — ry/8, the basin of attraction favourable 
to the slower evolving species 1 grows substantially (Panel B) |[T2l . For a twenty player game, d = 20, 
the basins of attractions have identical size for equal evolutionary rates, but the position of the internal 
equilibrium is shifted (Panel C). When species 1 evolves slower than species 2 in this situation, most of 
the initial conditions lead to a solution which is unfavourable to species 1 (Panel D). Thus for 20 players 
instead of two, the Red King effect is reversed (6 = 2 and c = 1). 



the outcome favourable for the faster evolving species. 

The bottom left and the top right quadrants have equal size when the internal equi- 
librium \s a\ X = y = 0.5. For a fixed b and c we cannot select any arbitrary number 
of players d to obtain this equilibrium, as d is not a continuous variable. If the equilib- 
rium is above x = 0.5, then a decrease in the evolutionary rate can be beneficial as 
demonstrated by the Red King effect. Conversely, if the equilibrium is below x = 0.5, 
then an increase in the evolutionary rate might be favourable. Hence if the number of 
players positions the equilibrium at x < 0.5 then the faster evolving species would be 
favoured. 

Asymmetries have been considered in mutualistic species at the level of species 
or other properties of the system such as interactions [38], interaction lengths [11 J or 
growth rates [12J. Asymmetry in the number of interacting partners has only been 
recently tackled [30J. Going back to the example of ants and larvae, a single larva 
is tended to by multiple ants. Thus while from each ant's point of view this is a two 
player game, for the larva this would be a multiplayer game. Where such multiplayer 
games are feasible, it is also possible that a certain quorum needs to be fulfilled for 
the game to proceed. Client fish have been shown to choose cleaning stations with 
two cleaners over solitary cleaners [39J. A certain number of ants are required to 
save a caterpillar from its predator. It has been shown that the amount of secretions 
of a lycaenid larva is correlated to the number of attending ants [40J. In the following 
two paragraphs we explore these two points, asymmetry in the number of players for 
the two species and different thresholds in either species to start off the benefits of 
mutualistic relations. 

Instead of the single parameter d, now we have di and d2 as the number of players 
for the two species 1 and 2. For symmetric evolutionary rates, if the two species play 
different player games (di ^ ^2) then the basins of attraction become asymmetric. 
Hence, if a species is currently at a disadvantage, a modification of the number of 
players or the evolutionary rate may put it on equal footing with the other species. 
Due to asymmetric number of players the sizes of the basins of attraction depends 
not just on the sizes of the quadrants but also on the shape of the curve separating 
the basins of attraction. Thus, it is possible to counter the Red King effect by changing 
the number of interacting agents (Fig. [2}. 

Until now, we have considered that a single "Generous" individual can generate 
the benefit of mutualism (M = 1). To begin with the simplest multiplayer case, we 
consider a symmetric three player game with different thresholds in either species to 
start off the benefits of mutualistic relations (say for species 1 the threshold is Mi and 
similarly for species 2 is M2 where in general M^ can range from 1 to di). 

The payoff matrices become asymmetric due to the different thresholds for the two 
species. Here, it matters which dynamics we are studying, the usual replicator dynam- 
ics or the modified replicator equations (Fig.[3]and see Appendix) as they can result 
in different sizes of the basins of attraction. The choice of dynamics depends on the 
details of the model system under consideration. Ultimately, thejriacroscopic dynam- 
ics can be derived from the underlying microscopic process [4T, 42J. Manipulating the 
thresholds can also change the nature of the game from coexistence to coordination 
(341 . which implies that different social dilemmas arise in multiplayer games. 
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Figure 2. The Red King effect can be neutralised and/or even reversed if the number of players increases. 
Here we show the scenario explored in 1 12| on the left panel; a two player game (di — d2 — 2) with 
Tx = ^y/8- Most of the initial conditions lead towards the state favourable for species 1, {Si^ ^2). 
This changes when the number of players in species 2 increases from ^2 = 2 to ^2 = 3, i.e. now one 
individuals of species 2 interact with two individuals of species 1. The horizontal and vertical lines 
denote the positions where the change in the strategy frequency is zero for species 1 and 2 respectively. 
The solution for species 2 (vertical line) moves towards smaller x, increasing the size of the top right 

3(2b-c)-^3(46c-c2) 
2(36-c) ' 



quadrant. For di — 2 and ^2 = 3, it is given by x 



whereas the the solution 



for species 2 is still y 



'^{b-c) 



2b-c (^^^ Appendix). Thus, the quadrant favouring the species with a faster 
evolutionary rate grows. Since the number of players affects the size of these quadrants, it can eliminate 
or magnify the Red King effect. 



DISCUSSION 



Interspecific relationships are exceedingly complex [43l. The development of a 
game theoretical approach for such multiplayer mutualisms requires an approach be- 
yond that arising typically in multiplayer social dilemmas [44J. In a mutualistic frame- 
work, it is best for the two species to cooperate with each other. We do not ask the 
question how these mutualisms arise. Rather when they do, what is the best strategy 
to contribute towards the common benefit [7, 45J? It would be possible to include 
the interactions between the individuals of the same species, as has been explored 
experimentally recently [30J. It has also been shown [40] that the amount of larval se- 
cretions is also influenced by the quality of the other larvae in the group. But then, we 
would be shifting our focus from the problem of interspecific mutualism to intraspecific 
cooperation [15]. Here, we have focused on the interspecific interactions, where the 
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interacting partners are always picked from the other species [46]. Bergstrom and 
Lachmann have shown that in such a mutualistic scenario, the species which evolves 
slower can get away with being selfish and force the other species to make a gen- 
erous contribution. They termed this as the Red King effect. If we include multiple 
players then the Red King effect is much more complex. 

For simplicity, usually pairwise interactions are assumed in game theoretical ar- 
guments. For modeling collective phenomena [47, '48J, multiplayer games may be 
necessary. The exact number of players is a matter of choice, though. Group size 
distributions give us an idea about the mean group size of a species. Instead of us- 
ing pairwise interactions or an arbitrary number of individuals to form a group, we 
could use the mean group sizes as the number of interacting individuals. Group size 
is known to be of importance in mutualisms [3J. As we have seen here, it can be a 
influential factor in deciding how the benefits are shared. Countering the Red King or 
enhancing its effect is possible by altering the group size. Hence can the group size 
itself be an evolving strategy? The study of group size distributions has been tackled 
theoretically [ 48-56 J and empirically in various species ranging from house sparrows 
to humans g8|[49l|571|58l. In our example of ants and butterfly larvae, it has been 
observed that a larva was most successful in getting more ant attendants in a group 
of four larvae [18J. It would be interesting to see if the distributions in mutualistic 
species peak at the group size which is the best response to their symbiont partners 
choices. This brings forth another of our assumption also implicit in [12J. The rate 
at which strategies evolve is assumed to be much faster than the rate at which the 
evolutionary rates or as just mentioned, the group size evolve. If these traits are ge- 
netically determined then this assumption may no longer hold. The rate of evolution 
is typically assumed to be constant, but it could well be a variable, subject to evolu- 
tion. We have seen that the number of players can affect whether evolving slower or 
faster is favourable. It would then be interesting to determine the interplay between 
the evolving group size and the evolving evolutionary rate and what effect it has on 
the dynamics of strategy evolution. 

Another method of introducing asymmetry is to have different payoff tables for the 
two species (i.e. different benefits and costs for the two species). Also we have just 
considered two strategies per species. Asymmetric number of strategies can induce 
further asymmetries in the interaction [46J. The intricacies of multiplayer games lend 
themselves to study such systems, but they also show that mutualistic interactions 
may be far more complex than often envisioned. Applying multiplayer game theory to 
mutualism unravels this dynamics between species and can be used to understand 
the complexity of these non-linear systems. 
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Figure 3. A three player game with asymmetric thresholds, but rx = ry. Species 1 and species 2 are 
both playing a three player game. For species 1, it is enough if one individual is "Generous" to produce 
the benefit (Mi = 1). For species 2, however, the minimum number of "Generous" players required to 
produce any benefit strongly affects the replicator dynamics. For M2 = Mi = 1, we observe symmetric 
basins of attraction. The manifolds for the saddle point plotted forward in time (dashed green lines) 
and backward in time (solid green lines) can be used to define the basins of attraction. For M2 = 2, we 
observe a region with closed orbits in the interior (white background), almost all initial conditions outside 
this region lead to (Gi , 82)- For M2 = 3, we observe closed orbits in almost the whole state space. To 
avoid negative payoffs and to facilitate the comparison with the modified dynamics (see Appendix), we 
have added a background fitness of 1.0 to all payoffs, but this does not alter the dynamics here. 



Appendix A: Evolutionary games within a species and between two species 
1 . Evolutionary games within a single species 



In evolutionary game theory two player games with two strategies have been stud- 
ied in great detail in infinitely large populations. Typically, two players meet, interact 
and obtain a payoff. The payoff is then the basis for their reproductive success and 
hence for the change in the composition of the population [59J. Consider two strate- 
gies, G and S. We define the payoffs by aij where the strategy of the focal individual 
is i and strategy of the other interacting individual is j. For example, when an G 
strategist meets another person playing G she gets a^G- She gets ac^s when she 
meets a S strategist. This leads to the payoff matrix 





G S 




G ClG,G CLG,S 

S as^G (is,s 


two strategies are given by, 

fcix) = ac.GX + aG,5(l - x] 
fs{x) = as,GX^as,s{^-x) 



(A.1) 
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where x is the frequency of the players with strategy G and 1 - x the frequency of 
players with strategy S. Typically these average payoffs are directly considered as the 
average fitnesses of the two strategies. This framework is used for biological systems, 
where strategies spread by genetic reproduction and often also for social systems 
where strategies spread by imitation. This concept is valid for interactions within a 
species where the evolutionary dynamics of strategies within the species is of interest. 
But quite often, interactions are not between two players, but between whole groups 
of players. Quorum sensing, group hunting or climate preservation represent such 
multiplayer examples. Such multiplayer games have been analyzed in the context 
of the evolution of cooperation [60-65], but only recently in a more general sense 
(34l[36l[3Zl[66]. The complexity brought to the table by such multiplayer interactions 
can be illustrated by adding just one more player in the previous setup. Now instead 
of a two player game if we have a three player game then the payoff table is. 



GG GS SS 

G ac^G.G CLG,G,S CLG,S,S 
S as,G,G CiS,G,S CiS,S,S 

The fitnesses of the two types in such a case are given by, 

fG{x) = aG,G,Gx'^ + 2aG,G,sx{l - x) + ac, 5,5(1 - x)'^ 

fs{x) = as,G,Gx'^ + 2as,G,sx{l - x) + a5,5,5(l - xf (A.2) 

where the nonlinearity of order two comes from the fact that each focal individual 
interacts with 2 other individuals. Since we assume that the order of players does 
not matter we get a binomial coefficient of 2 when playing with two individuals with 
different strategies. 

In whichever way the fitness is calculated, the evolution of the frequency of strategy 
G is given by the replicator equation, 

X = x{fG{x) - fix)) (A.3) 

where f{x) = xfc + (1 - x)fs is the average fitness of the species. 

2. Evolutionary games between two species 

The above section was the traditional way of analyzing evolutionary games (either 
two or multiplayer) within a species but when species interact then we need to formal- 
ize the interactions in a different manner. Just as in the previous section the average 
fitnesses were a function of the frequency of the strategies within the species (e.g. 
/g(x)), here we assume that fitness depends on the frequency of the strategies in the 
other species (e.g. /g(^))- It is indeed possible to incorporate even more complexity 
by making the fitness depend on both the frequencies of strategies within the species 
and from the other species but that case is much more complicated and beyond the 
scope of this paper. Interested readers are referred to [67J. For simplicity we stick to 
the assumption from coevolutionary models of interspecific dependence only [68, 69). 



11 



(A) Two player game for both species 

Species 1 plays a two player game Species 2 plays a two player game 
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(B) Asymmetric player game for the two species 

Species 1 plays a two player game Species 2 plays a three player game 
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(C) Three player game for both species 

Species 1 plays a three player game Species 2 plays a three player game 
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Figure A.4. Evolutionary games between two species. Each species is composed of players of two 
strategies denoted by the light and the dark circles. (A) If both the species are playing a two player game 
then from both the species we choose one player each to form the interaction groups. (B) Species 1 plays 
a two player game, hence for this pairwise interaction we choose a single species two player to interact 
with a single species 1 player (blue dashed oval). Species 2 plays a three player game, hence one player 
of species 2 interacts with two players of species 1 (red dotted oval). (C) If both species are playing a 
three player game then for a single player of species 1 we pick two players from species 2 (blue dashed 
oval) and vice versa for a single player of species 2 (red dotted oval). Thus in general for a di player 
game for species 1 we need to pick di — 1 players from species 2 and for a d2 player game for species 
2 we need to pick d2 — I players from species 1. 
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For two player games between species (Fig. |A.4| A) now we need to pick one player 
from each species and they play the game. For simplicity we assume that both the 
populations have the same strategies G and S. The fact that they belong to different 
species is now denoted by an index for d and Si with i = 1,2. Thus the payoff 
matrices describing the interactions are, 

Species 2 Species 1 



G2 S2 Gi Si 



Species 1 ^^ ""^^'^^ ""^^'^^ Species 2 ^^ ""^^'^^ ""^^'^^ 



with the respective average fitnesses now being, 

fCriy) = CLGi,G2y + «Gi,52(l " V) 

fsAy) =«5i,G2^ + «5i,52(l-^) (A.4) 

fel^) = «G2,Gi^ + «G2,5i(l - x) 

fs2{x) = a52,Gi^ + tt52,5i(l -x). (A.5) 

Increasing the number of players in now an additional complication. Hence, we pro- 
ceed by an addition of one more player in just one of the species to illustrate the 
intricacy. Let us assume that species lis playing a two player game while species 
2 plays a three player game (see Fig. |A.4| B). This means that we need to pick one 



player each from the two species to make up the two player game but we need two 
players from species 1 and one player from species 2 to make up the three player 
game. This is because we have neglected intraspecific interactions as mentioned 
earlier. If both the species play a three player game (see Fig. |A.4| C) then we pick 



two player from each species and the games are again without including intraspecific 
interactions. 

Species 2 Species 1 



G2G2 G2S2 S2S2 GiGi GiSi Si Si 



Species 1 ^^ ^^1,^2,02 «Gi,G2,52 «Gi,52,52 Species 2 ^^ ^^2,^1,01 0.02,01, Si cig2,Si,Si 

^1 OSi,02,02 OSi,02,S2 OSi,S2,S2 ^2 OS2,Oi,Oi OS2,Oi,Si OS2,Si,Si 



and the respective average fitnesses are, 

foi {y) = «Gi,G2,G2^^ + 2aGi,G2,52y(i -y)^ ^01,52,52(1 - yf 

fsi (y) = as,,02,02y'^ + 2a5i,G2,52^(l - ^) + «5i,52,52(l - yf (A.6) 

f02{x) = «G2,Gi,Gi^^ + 2aG2,Gi,5i^(l - x) +aG2,5i,5i(l - x)'^ 

fs2{x) =a52,Gi,Gi^^ + 2a52,Gi,5i^(l -x) +a52,5i,5i(l -xf. (A.7) 

Even if the fitness is for a two player game or for a multiplayer game, once it is 
calculated we can determine the change in the frequency of strategy Gi and G2 via 
the replicator equations, one for each species, 

x = x{fG,{y) - fi{x,y)) 

y = y{fo2{x)-f2{x,y)). (A.8) 

where fi is the average fitness of species i. 
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Appendix B: The snowdrift game 
1. Two player setting 

So far, we have described general games within and between species, now we 
turn to a particular game which of interest to us when considering mutualism. The 
snowdrift game derives its name from the anecdote where two drivers are stuck in a 
snowdrift. They must shovel away the snow (paying the cost c) to reach home (benefit 
b) but there are three possible outcomes to this scenario. One of the driver shovels 
while the other stays warm in the car (6-c and b), both the drivers share the workload 
and shovel away the snow (b - c/2 and b - c/2) or none of them gets out of the car 
and they both remain stuck (0 and 0). 

Putting this game in perspective of the two species (i.e. the two drivers represent 
the two different species) we get the matrix. 







Species 2 


G2 S2 


Species 1 


Si 


b-c/2 b-c 
b 







Species 1 


Gi 5i 


Species 2 


G2 

S2 


b-c/2 b-c 
b 



where strategy G stands for being "Generous" and shoveling the snow while S stands 
for being "Selfish" and just sitting in the car. For 6 = 2 and c = 1 we recover the matrix 
used in [12J. 

For the snowdrift game in a single population there exists a single, stable internal 
equilibrium. Hence the population will evolve to a polymorphism which is a combi- 
nation of "Generous" and "Selfish" players. But in a two species system, this stable 
equilibrium turns into a saddle point, a small deviation from this fixed point can lead 
the system to one of the stable fixed point where one of the species is completely 
"Generous" and the other one is completely "Selfish". 



2. Multiplayer setting 

Following Souza et al. [34J, a multiplayer snowdrift game can be described by the 
payoff entries 

^6-f if k>M 
-f^ if k<M 




b ifk>M 

if k<M. ^ ^ 

In an interaction group, the "Selfish" players get the benefit b if the number of "Gen- 
erous" players, k, is greater than or equal to the threshold M. For the "Generous" 
individuals, their effort is subtracted from the payoffs. The effort is shared if the quo- 
rum size is met (f^), but is in vain for k < M. For two player games we had M = 1 
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but multiplayer games provide the possibility of exploring this threshold aspect of col- 
lective action games. This relates back to the concept of quorum sensing [TO] [7T1 
where a certain density has to be reached for the group benefit to be realized. From 
these payoff entries we need to calculate the average fitnesses of the strategies. For 
simplicity we just illustrate the fitnesses of the strategies in species 1. Just like in a 
three player game for species 1 we needed to pick two individuals from species 2, for 
a d player g ame for species 1 we need to pick d - 1 other individuals from species 
2 (See Fig. |A.4| C). We assume that the groups are randomly assembled from the 
composition of species 2. Indeed due to this random sampling the composition of the 
formed groups is given by a binomial distribution. Summing over all possible compo- 
sitions of groups we arrive at the average fitnesses of the two strategies in species 
1, 



fs^iy) = E ("^7 ^)^^(i - yr-'-''^sA^)• (A.3) 



Following the same procedure for the two strategies in species 2 leads to the average 
fitness of the two species 

fi{x,y) = xfcAy) + (1 - x)fsAy) 

h{x,y) = yfG,{x) + (1 - y)fsA^). (A.4) 

Appendix C: Dynamics in asymmetric conditions 

We have addressed two kinds of asymmetries in the game, the number of players 
and the thresholds in the two species. We denote the number of players for species 
1 and species 2 as di and d2, respectively. That is if species 2 is playing a d2 player 
game it mean s tha t one player from species 2 interacts with d2-l players of species 
1 (for e.g. Fig |A.4| B). For an asymmetry in the thresholds we use the two parameters 
Ml > 1 and M2 > 1 for the two species, respectively. 

For asymmetric bimatrix games, there is a difference in the dynamics between 
the standard replicator dynamics and the alternative dynamics put forth by Maynard 
Smith [59J. For this dynamics, the average fitness of each species appears as a 
denominator, 

X = r^x {fc, (y) - h (x, y)) //i (x, y) 

y = Tyy {fcA^) - f2{x,y)) /f2{x,y). (A.1) 

In our asymmetric bimatrix game, the fixed point stability is affecte d by the choice of 
the dynamics, in contrast to the case of symmetric games. In Fig. |A.5| we illustrate 
that the dynamics is different between the usual replicator dynamics and Eqs. \AA_ 

For di = d2> 5, the exact coordinates of the fixed point must be computed numer- 
ically (721 [ZSl- 
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Modified Replicator Dynamics 



M2=1 



M2=2 



M2=3 




Species 1 



Figure A.5. For the same parameters as in Fig. 3 (main text), the modified replicator dynamics given 
by Eqs. |A.l| leads to a different dynamics. For Mi = M2 = 1 (left), the dynamics is the same as for 
the standard replicator dynamics. For M2 = 2 (middle) and M2 = 3 (right), the formerly neutrally 
stable fixed point in the interior becomes a stable focus. Moreover, for M2 = 2, the basin of attraction 
of (Ci, 5*2) is much larger with the standard replicator dynamics. Again, we have added a background 
fitness of 1.0 to all the payoff entries so that all payoffs are positive. 
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